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SYSTEM AND METHOD FOR A SELF-OPTIMIZING RESERVATION IN TIME OF 

COMPUTE RESOURCES 

PRIORITY CLAIM 

[0001] The present application claims priority to U.S. Provisional Application No. 60/552,653 filed 
March 13, 2004, the contents of which are incorporated herein by reference. 

RELATED APPLICATIONS 

[0002] The present application is related to Attorney Docket Numbers 010-0011, 010-001 1A, 010- 
0011C, 010-0013, 010-0019, 010-0026, 010-0028 and 010-0030 filed on the same day as the present 
application. The contents of each of these cases is incorporated herein by reference. 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

[0003] The present invention relates to reservations in a cluster or more specifically to a system and 
method of providing a self-optimizing reservation in time of compute resources. . 

2. Introduction 

[0004] The present invention relates to a system and method of allocation resources in the context 
of a grid or cluster of computers. Grid computing may be defined as coordinated resource sharing 
and problem solving in dynamic, multi-institutional collaborations. Many computing projects 
require much more computational power and resources than a single computer may provide. 
Networked computers with peripheral resources such as printers, scanners, I/O devices, storage 
disks, scientific devices and instruments, etc. may need to be coordinated and utilized to complete a 
task. 

[0005] Grid/cluster resource management generally describes the process of identifying 
requirements, matching resources to applications, allocating those resources, and scheduling and 
monitoring grid resources over time in order to run grid applications as efficiendy as possible. Each 
project will utilize a different set of resources and thus is typically unique. In addition to the 
challenge of allocating resources for a particular job, grid administrators also have difficulty 
obtaining a clear understanding of the resources available, the current status of the grid and 
available resources, and real-time competing needs, of various users. One aspect of this process is 
the ability to reserve resources for a job. A cluster manager will seek to reserve a set of resources to 
enable the cluster to process a job at a promised quality of service. 
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[0006] General background information on clusters and grids may be found in several publications. 
See, e.g., Grid Resource Management State of the Art and Future Trends . Jarek Nabtzyski, Jennifer 
M. Schopf, and Jan Weglarz, Kluwer Academic Publishers, 2004; and Beowulf Cluster Computing 
with T J tnnx 1 edited by William Gropp, Ewing Lusk, and Thomas Sterling, Massachusetts Institute of 
Technology, 2003. 

[0007] It is generally understood herein that the terms grid and cluster are interchangeable in that 
there is no specific definition of either. In general, a grid will comprise a plurality of clusters as will 
be shown in FIG. 1 A. Several general challenges exist when attempting to maximize resources in a 
grid. First, there are typically multiple layers of grid and cluster schedulers. A grid 100 generally 
comprises a group of clusters or a group of networked computers. The definition of a grid is very 
flexible and may mean a number of different configurations of computers. The introduction here is 
meant to be general given the variety of configurations that are possible. A grid scheduler 102 
communicates with a plurality of cluster schedulers 104A, 104B and 104C. Each of these cluster 
schedulers communicates with a respective resource manager 106A, 106B or 106C. Each resource 
manager communicates with a respective series of compute resources shown as nodes 108A, 108B, 
108C in cluster 110, nodes 108D, 108E, 108F in cluster 112 and nodes 108G, 108H, 1081 in cluster 
114. 

[0008] Local schedulers (which may refer to either the cluster schedulers 104 or the resource 
managers 106) are closer to the specific resources 108 and may not allow grid schedulers 102 direct 
access to the resources. Examples of compute resources include data storage devices such as hard 
drives and computer processors. The grid level scheduler 102 typically does not own or control the 
actual resources. Therefore, jobs are submitted from the high level grid-scheduler 102 to a local set 
of resources with no more permissions that then user would have. This reduces efficiencies and can 
render the reservation process more difficult. 

[0009] The heterogeneous nature of the shared resources also causes a reduction in efficiency. 
Without dedicated access to a resource, the grid level scheduler 102 is challenged with the high 
degree of variance and unpredictability in the capacity of the resources available for use. Most 
resources are shared among users and projects and each project varies from the other. The 
performance goals for projects differ. Grid resources are used to improve performance of an 
application but the resource owners and users have different performance goals: from optimizing 
the performance for a single application to getting the best system throughput or minimizing 
response time. Local policies may also play a role in performance. 

[0010] Within a given cluster, there is only a concept of resource management in space. An 
administrator can partition a cluster and identify a set of resources to be dedicated to a particular 
purpose and another set of resources can be dedicated to another purpose. In this regard, the 
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resources are reserved in advance to process the job. There is currently no ability to identify a set of 
resources over a time frame for a purpose. By being constrained in space, the nodes 108A, 108B, 
108C, if they need maintenance or for administrators to perform work or provisioning on the 
nodes, have to be taken out of the system, fragmented permanendy or partitioned permanendy for 
special purposes or policies. If the administrator wants to dedicate them to particular users, 
organizations or groups, the prior art method of resource management in space causes too much 
management overhead requiring a constant adjustment the configuration of the cluster environment 
and also losses in efficiency with the fragmentation associated with meeting particular policies. 
[0011] To manage the jobs submissions, a cluster scheduler will employ reservations to insure that 
jobs will have the resources necessary for processing. Figure IB illustrates a cluster/node diagram 
for a cluster 124 with nodes 120. Time is along the X axis. An access control list 114 (ACL) to the 
cluster is static, meaning that the ACL is based on the credentials of the person, group, account, 
class or quality of service making the request or job submission to the cluster. The ACL 114 
determines what jobs get assigned to the cluster 110 via a reservation 112 shown as spanning into 
two nodes of the cluster. Either the job can be allocated to the cluster or it can't and the decision is 
determined based on who submits the job at submission time. The deficiency with this approach is 
that there are situations in which organizations would like to make resources available but only in 
such a way as to balance or meet certain performance goals. Particularly, groups may want to 
establish a constant expansion factor and make that available to all users or they may want to make 
a certain subset of users that are key people in an organization and want to give them special 
services but only when their response time drops below a certain threshold. Given the prior art 
model, companies are unable to have the flexibility over their cluster resources. 
[0012] To improve the management of cluster resources, what is needed in the art is a method for a 
scheduler, a cluster scheduler or cluster workload management system to manage resources in a 
dimensional addition to space. Furthermore, given the complexity of the cluster environment, what 
is needed is more power and flexibility in the reservations process. 



SUMMARY OF THE INVENTION 

[0013] Additional features and advantages of the invention will be set forth in the description 
which follows, and in part will be obvious from the description, or may be learned by practice of the 
invention. The features and advantages of the invention may be realized and obtained by means of 
the instruments and combinations particularly pointed out in the appended claims. These and other 
features of the present invention will become more fully apparent from the following description 
and appended claims, or may be learned by the practice of the invention as set forth herein. 
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[0014] The invention includes systems, methods and computer-readable media embodiments. The 
method aspect of the invention comprises a method of dynamically controlling a reservation of 
resources within a compute environment to maximize a response time. The compute environment 
may be a cluster, grid or any environment of a plurality of compute devices. The method comprises 
receiving from a requestor a request for a reservation of resources in the cluster environment, 
reserving a first group of resources and evaluating resources within the cluster environment to 
determine if the response time can be improved. If the response time can be improved, the method 
comprises canceling the reservation for the first group of resources and reserving a second group of 
resources to process the request at .the improved response time. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0015] In order to describe the manner in which the above-recited and other advantages and 
features of the invention can be obtained, a more particular description of the invention briefly 
described above will be rendered by reference to specific embodiments thereof which are illustrated 
in the appended drawings. Understanding that these drawings depict only typical embodiments of 
the invention and are not therefore to be considered to be limiting of its scope, the invention will be 
described and explained with additional specificity and detail through the use of the accompanying 
drawings in which: 

[0016] FIG. 1A illustrates generally a grid scheduler, cluster scheduler,. and resource managers 
interacting with compute nodes; 

[0017] FIG. IB illustrates an access control list (ACL) interacting with a group of nodes; 

[0018] FIG. 2A illustrates a method embodiment of the invention; 

[0019] FIG. 2B illustrates another method embodiment of the invention; 

[0020] FIG. 2C illustrates yet another method embodiment of the invention; 

[0021] FIG. 2D illustrates yet another method embodiment of the invention; 

[0022] FIG. 2E illustrates yes another method embodiment of the invention; 

[0023] FIG. 3A illustrates a reservation sandbox; 

[0024] FIG. 3B illustrates aspects of a reservation sandbox; 

[0025] FIG. 4 illustrates a rollback reservation; 

[0026] FIG. 5 illustrates another aspect of the rollback reservation; 

[0027] FIG. 6 illustrates a dynamic access control list; and 

[0028] FIG. 7 illustrates an interface for creating a reservation. 
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DETAILED DESCRIPTION OF THE INVENTION 

[0029] Various embodiments of the invention ate discussed in detail below. While specific 
implementations are discussed, it should be understood that this is done for illustration purposes 
only. A person skilled in the relevant art will recognize that other components and configurations 
may be used without parting from the spirit and scope of the invention. 
[0030] The present invention relates to resource reservations in the context of a cluster 
environment. The cluster may be operated by a hosting facility, hosting center, a virtual hosting 
center, data center, grid, cluster and/or utility-based computing environments. Software modules 
and components operate within a computing environment to manage the reservations of resources. 
The "system" embodiment of the invention may comprise a computing device that includes the 
necessary hardware and software components to enable a workload manager or a software module 
performing the steps of the invention. Such a computing device may include such known hardware 
elements as one or more central processors, random access memory (RAM), read-only memory 
(ROM), storage devices such as hard disks, communication means such as a modem or a card to 
enable networking with other computing devices, a bus that provides data transmission between 
various hardware components, a keyboard, a display, an operating system and so forth. There is no 
restriction that the particular system embodiment of the invention have any specific hardware 
components and any known or future developed hardware configurations are contemplated as 
within the scope of the invention when the computing device operates as is daimed. 
[0031] An advance reservation is the mechanism by which the present invention guarantees the 
availability of a set of resources at a particular time. With an advanced reservation a site has an 
ability to actually specify how the scheduler should manage resources in both space and time. Every 
reservation consists of three major components, a list of resources, a timeframe (a start and an end 
time during which it is active), and an access control list (ACL). These elements are subject to a set 
of rules. The ACL acts as a doorway determining who or what can actually utilize the resources of 
the duster. It is the job of the cluster scheduler to make certain that the ACL is not violated during 
the reservation's lifetime (i.e., its timeframe) on the resources listed. The ACL governs access by the 
various users to the resources. The ACL does this by determining which of the jobs, various 
groups, accounts, jobs with spedal service levds, jobs with requests for spedfic resource types or 
attributes and many different aspects of requests can actually come in and utilize the resources. 
With the ability to say that these resources are reserved, the scheduler can then enforce true 
guarantees and can enforce polides and enable dynamic administrative tasks to occur. The system 
greatly increases in effidency because there is no need to partition the resources as was previously 
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necessary and the administrative overhead is reduced it terms of staff time because things can be 
automated and scheduled ahead of time and reserved. 

[0032] As an example of a reservation, a reservation may specify that node002 is reserved for user 
John Doe on Friday. The scheduler will thus be constrained to make certain that only John Doe's 
jobs can use node002 at any time on Friday. Advance reservation technology enables many features 
including backfill, deadline based scheduling, QOS support, and meta scheduling. 
[0033] There are several reservation concepts that will be introduced as aspects of the invention. 
These include dynamic reservations, co-allocating reservation resources of different types, 
reservations that self-optimize in time, reservations that self-optimization in space, reservations 
rollbacks and reservation masks. Each of these will be introduced and explained. 
[0034] Dynamic reservations are reservations that are able to be modified once they are created. 
FIG. 2A illustrates a dynamic reservation. Attributes of a reservation may change based on a 
feedback mechanism that adds intelligence as to ideal characteristics of the reservation and how it 
should be applied as the context of its environment or an entities needs change. One example of a 
dynamic reservation is a reservation that provides for a guarantee of resources for a project unless 
that project is not using the resources it has been given. A job associated with a reservation begins 
in a cluster environment (202). At a given portion of time into processing the job on compute 
resources, the system receives compute resource usage feedback relative to the job (204). For 
example, a dynamic reservation policy may apply which says that if the project does not use more 
than 25% of what it is guaranteed by the time that 50% of its time has expired, then, based on the 
feedback, the system dynamically modifies the reservation of resources to more closely match the 
job (206). In other words, the reservation dynamically adjust itself to reserve X% fewer resources 
for this project, thus freeing up unused resource for others to use. 

[0035] Another dynamic reservation may perform the following step: if usage of resources 
provided by a reservation is above 90% with fewer than 10 minutes left in the reservation then the 
reservation will attempt to add 10% more time to the end of the reservation to help ensure the 
project is able to complete. In summary, it is the ability for a reservation to receive manual or 
automatic feedback to an existing reservation in order to have it more accurately match any given 
needs, whether those be of the submitting entity, the community of users, administrators, etc. The 
dynamic reservation improves the state of the art by allowing the ACL to the reservation to have a 
dynamic aspect instead of simply being based on who the requestor is. The reservation can be 
based on a current level of service or response time being delivered to the requestor. 
[0036] Another example of a dynamic reservation is consider a user submitting a job and the 
reservation may need an ACL that requires that the only job that can access these resources are 
those that have a queue time that is currently exceeded two hours. If the job has sat in the queue 
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for two hours it will then access the additional resources to prevent the queue time for the user 
from increasing significantly beyond this time frame. You can also key the dynamic reservation off 
of utilization, off of an expansion factor and other performance metrics of the job. 
[0037] The ACL and scheduler are able to monitor all aspects of the request by looking at the 
current job inside the queue and how long it has sat there and what the response time target is. It is 
preferable, although not required, that the scheduler itself determines whether all requirements of 
the ACL are satisfied. If the requirements are satisfied, the scheduler releases the resources that are 
available to the job. 

[0038] The benefits of this model is it makes it significandy easier for a site to balance or provide 
guaranteed levels of service or constant levels of service for key players or the general populace. By 
setting aside certain resources and only making diem available to the jobs which threaten to violate 
their quality of service targets it increases the probability of satisfying it. 

[0039] Another reservation type is a self optimizing reservation in time. This is shown in FIG. 2B. 
In many cases, people will request resources and request that they be available at a particular time. 
For example, a person is doing a demonstration and it happens to be from 2:00 pm to 4:00 pm. In 
many other cases, people will simply have a deadline or simply want processing as early as possible. 
With a self-optimizing in time reservation, the scheduler is actually able to lock in a set of resources 
for a particular request and then over time evaluate the cluster resources and determine if it can 
actually improve on it and improve on the reservation in such a way as to guarantee that it does not 
lose the resources that it has already made available. 

[0040] The method aspect of the invention relates to a method of dynamically controlling a 
reservation of resources within a cluster environment to maximize a response time for processing 
the reservation. The method comprises receiving from a requestor a request for a reservation of 
resources in the cluster environment (210), reserving a first group of resources and guaranteeing to 
the requestor a response time to process the request (212), evaluating resources within the cluster 
environment to determine if the response time can be improved (214) and determining whether the 
response time can be improved (216). If the response time can be improved, the system cancels the 
reservation for the first group of resources and reserves a second group of resources to process the 
request at the improved response time (218). If the response time cannot be improved, then the 
system continues to evaluate the resources according to step 214. 

[0041] The reservation for the first group of resources and the reservation for the second group of 
resources can overlap in time and/or in terms of the physical resources, or other resources such as 
software, or license rights, etc. that are reserved. With self-optimizing reservations in time, a 
particular request may come in request resources that meet the following criteria but the requester 
prefers resources that meet a more increasingly strict criteria. The scheduler, in finding the 
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reservation, may be able to satisfy the required criteria but not necessarily satisfy all the preferred 
criteria. Over time, the scheduler, once it has established a reservation that meets the minimum 
criteria, it can continue to look at newly freed up resources and determine if it can, to a larger and 
larger extent, satisfy the preferred resource needs as well. 

[0042] The self optimizing reservation technology is also useful to work around resource failures in 
the case of a reservation that has already had reserved all the resources it needs and it has a node 
failure. Other types of resources failures may also be monitored and reservations modified to meet 
the original promised quality or service or response time to the requestor. For example, one the 
requestor submits a request for a reservation of resources, and the system promises a certain 
response time and reserves a group of resources, the system will monitor those resources for failure. 
If a component of the group of resources fails, such as a node, or a router, or memory or a CPU, 
the system will seek to modify the reservation by identifying replacement resources that can be 
included in the reservation such that the promised quality of service can be met The system can 
actually continue to locate resources and reallocate resources that are still up and running and be 
able to satisfy the time frame it originally promised by excluding the failed node and picking up a 
newly available compute node. This may be performed by modifying the original reservation, or 
canceling the original reservation and reserving a second group of resources that excludes the failed 
resource and includes the reallocated working resource such that the requestor maintains his or her 
quality of service. 

[0043] The determination of whether the response time can be improved may includes a 
comparison of a cost of canceling the first group of resources and reserving the second group of 
resources with the improved response time gained from meeting at least one of the preferred 
criteria. In this regard, a threshold value may be established that indicates when overall resource 
efficiency may be improved in that enough of the preferred criteria may be met to overcome the 
cost of canceling a reservation and establishing a the new reservation of resources. 
[0044] FIG. 4 illustrates the roll-back reservation mask 402. An important concept in this type of 
reservation is that it stays ahead of the current time by either a fixed or dynamic amount of time 
408. A method embodiment of this reservation is shown in one aspect in FIG. 2B. As the self- 
optimization registration slides forward at a fixed (or dynamic) distance in the future (230), it 
analyses reservations, jobs, objects or other resources 404 (232) and determines whether the level 
of service may be improved (234), If yes, the method comprises creating a new reservation and 
making the associated changes (236) and then leaves them 406 behind to be processed when the 
current time catches up. 

[0045] A self optimizing reservation will only slide forward barring resource failure of the actual 
compute resources. It does this by, when it makes a query to determine what resources are 
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available, as part of its algorithm, it determines that it has availability to both free resources and the 
resources it already has reserved. In such a case in then goes and analyzes it, looks at resources that 
were recendy freed by other workload and other reservations that completed early which is actually 
quite common in a cluster environment, and if it can find that it can improve the level of service 
delivered to the request or it will actually create the new reservation and will remove the old 
reservation and adjust things as needed. A self optimizing reservation therefore has the ability to 
improve any given attribute of service to the submitting entity, community of users, administrators, 
etc. 

[0046] Another aspect of the self-optimizing reservation in time is illustrated in FIG. 2D. A 
reservation is created for a job on a cluster environment (210). Self optimizing may consist of 
improving response time, starting the reservation earlier if possible, adding additional resources as 
available, using fewer resources when fewer resources are required. Another example of a self- 
optimizing reservation is if an organization were trying to guarantee a specific number of compute 
nodes, say 32 for instance, and at first look the first time that 32 nodes can be available is in three 
days, but if they were available earlier the using organization would want them earlier. Other 
reservations and cluster resources are monitored (212). As time goes on, if another reservation 
ends its usage earlier and now the 32 node reservation can be set up in only 2 days. The system 
determines whether an optimization of the reservation exits (214). If yes, that an optimization 
exists, the reservation self-optimizes (216) and changes its start date ahead by one day. If no 
optimization can occur, the system continues to monitor the cluster resources (212). Yet another 
example of a self-optimizing reservation is that a group reserves 8 nodes for 4 hours, but would 
really prefer to get more nodes to get the work done faster. Due to' another reservation concluding 
early, this reservation can now self-optimize and run the jobs on 32 nodes for just one hour and the 
using group is done four times faster. 

[0047] Another reservation is the self-terminating reservation. FIG. 2C illustrates this reservation. 
A self-terminating reservation is a reservation that can cancel itself if certain criteria take place. As a 
reservation time begins for a job (220), the system monitors for jobs and cluster resources (222). 
An example of a self-terminating reservation is a reservation that uses an event policy to check that 
if after 30 minutes no jobs have been submitted against the reservation, or if utilization of the 
assigned resources is below x% then the reservation will cancel itself, thus making those resources 
available to be used by others. Thus, if monitored events justify terminating the reservation (224), 
then the reservation terminates itself (226). If the monitored events do not justify canceling the 
reservation, the system continues to monitor events (222). 

[0048] FIG. 3A illustrates a standing reservation. In cluster 302, there are standing reservations 
shown as 304A, 304B and 304C. These reservations show resources allocated and reserved on a 
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periodic basis. These are consuming reservations meaning that cluster resources will be consumed 
by the reservation. 

[0049] Another embodiment of reservation is something called a reservation mask, which allows a 
site to create "sandboxes" in which other guarantees can be made. The most common aspects of 
this reservation are for grid environments and personal reservation environments. In a grid 
environment, a remote entity will be requesting resources and will want to use these resources on an 
autonomous cluster for the autonomous cluster to participate. In many cases it will want to 
constrain when and where the entities can reserve or utilize resources. One way of doing that is via 
the reservation mask. 

[0050] FIG. 3B illustrates the reservation mask shown as creating sandboxes 306A, 306B, 306C in 
cluster 310 and allows the autonomous cluster to state that only a specific subset of resources can 
be used by these remote requesters during a specific subset of times. When a requester asks for 
resources, the scheduler will only report and return resources available within this reservation, after 
which point the remote entity desires it, he can actually make a consumption reservation and that 
reservation is guaranteed to be within the reservation mask space. The consumption reservations 
312A, 31 2B, 312C, 31 2D are shown within the reservation masks. 

[0051] In cluster 310 the reservation masks operate differently from consuming reservations in that 
they are enabled to allow personal reservations to be created within the space that is reserved. 
ACL's are independent inside of a sandbox reservation or a reservation mask in that one can also 
exclude other requesters out of those spaces so they're dedicated for these particular users. 
[0052] The benefits of this approach include preventing local job starvation, and providing a high 
level of control to the cluster manager in that he or she can determine exactly when, where, how 
much and who can use these resources even though he doesn't necessarily know who the requesters 
are or the combination or quantity of resources they will request. The administrator can determine 
when, how and where requestors will participate in these grids. A valuable use is in the space of 
personal reservations which typically involves a local user given the authority to reserve a block of 
resources for a rigid time frame. Again, with a personal reservation mask, the requests are limited to 
only allow resource reservation within the mask time frame and mask resource set, providing again 
the adrninistrator the ability to constrain exactly when and exactly where and exactly how much of 
resources individual users can reserve for a rigid time frame. The individual user is not known 
ahead of time but it is known to the system, it is a standard local cluster user. 
[0053] The reservation masks 306A, 306B and 306C define periodic, personal reservation masks 
where other reservations in a cluster 310 may be created, i.e., outside the defined boxes. These are 
provisioning or policy-based reservations in contrast to consuming reservations. In this regard, the 
resources in this type of reservation are not specifically allocated but the time and space defined by 
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the reservation mask cannot be reserved for other jobs. Reservation masks enable the system to be 
able to control the fact that resources are available for specific purposes, during specific time 
frames. The time frames may be either single time frames or repeating time frames to dedicate the 
resources to meet project needs, policies, guarantees of service, administrative needs, demonstration 
needs, etc. This type of reservation insures that reservations are managed and scheduled in time as 
well as space. Boxes 308A, 308B, 308C and 308D represent non-personal reservation masks. They 
have the freedom to be placed anywhere in cluster including overlapping some or all of the 
reservation masks 306A, 306B, 306C. Overlapping is allowed when the personal reservation mask 
was setup with a global ACL. A global ACL is an ACL that anyone can use. It is wide open in the 
sense that anyone can take advantage of the resources within that space. To prevent the possibility 
of an overlap of a reservation mask by a non-personal reservation, the administrator can set an ACL 
to constrain it is so that only personal consumption reservations are inside. These personal 
consumption reservations are shown as boxes 312B, 312A, 312C, 312D which are constrained to be 
within the personal reservation masks 306A, 306B, 306C. The 308A, 308B, 308C and 308D 
reservations, if allowed, can go anywhere within the cluster 310 including overlapping the other 
personal reservation masks. The result is the creation of a "sandbox" where only personal 
reservations can go without in any way constraining the behavior of the scheduler to schedule other 
requests. 

[0054] Another reservation type is the reservation roll-back shown in FIG. 4. This reservation has 
particular application for enforcing policies or allowing support for service level guarantees in 
service level agreements. A level of service guarantee allows a site or cluster to guarantee that a 
particular consumer or organization or type of credential is guaranteed a certain quantity of 
resources within a certain amount of time. The standard way to provide those guarantees would be 
to dedicate a block of resources that satisfy the needs and would be statically and rigidly partitioned 
so that no one else could access it. The request of that organization could not extend beyond the 
bounds of the dedicated block. 

[0055] With the present invention regarding the reservation roll-back, an administrator can create a 
reservation 402 which enforces its policy and continues to float in time a certain distance 408 ahead 
of the current time. Typically the rectangular area of the reservation has a height that corresponds 
to guaranteed throughput when processing jobs and the horizontal distance that corresponds to the 
length in time of the reservation. The reservation 402 may correspond to a certain amount of time 
according to a service level agreement, such as 3 or 4 months for example. The reservation 402 may 
extend into infinity as well if there is no defined ending time. The reservation 402 is a provisioning 
reservation and maintains the time offset 402 to the current time. 
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[0055] To illustrate the reservation roll-back, consider a service level agreement with a company to 
have twenty resources available within one hour of the request for the resources and that they can 
make the request anytime. The time offset 408 can then be set to one hour and the company will 
never will they wait more than one hour to get up to twenty resources. The reservation 402 
monitors the resources and when a request is made for resources, consumption reservations 404 are 
allocated and left behind 406 as the roll-back reservation maintains its offset. 
[0057] An implementation with reservation rollback would allow a site to set up basically a floating 
reservation that extends from one hour in the future until a time further in the future, such as 4 or 8 
hours in the future, and continues to slide forward in time. The reservation 402 will only allow jobs 
from this organization can drop down requests or reserve host resources underneath the 
reservation. As time moves forward, the reservation slides forward in time so it always maintains a 
constant distance in the future allowing these guarantees 404 to be created and maintained 406 on 
the cluster. 

[0058] The time offset 408 may be static or dynamic, A static offset 408 will maintain a constant 
offset time, such as one hour into the future. The static offset will likely be set by a service level 
agreement wherein a company requests that the resources become available within an hour. The 
offset 408 may also by dynamic. There may be requests in the service level agreement where under 
a given event or set of events, the offset would change wherein the reservation slides closer or 
farther away from the current time to provide a guarantee of resources within V2 (instead of 1 hour) 
or 2 hours in the future. There are a variety of ways to vary the offset. One can be to simply cancel 
the current sliding reservation and create a new reservation at a different offset Another way would 
be to maintain the current reservation but slide it closer or farther away from the current time. The 
factors that adjust the dynamic nature of the offset may be based on company requests, the nature 
and use of the cluster resources, the time the request is made, historical information, and so forth. 
For example, if the request for resources is made at midnight on a Friday night, perhaps instead of 
the 1 hour availability of resources, the hosting center analyzes the cluster resources and the time of 
the request and determines that it can deliver the resources in V2. The company may want a flexible 
offset where if the request is made during a block of time such as between 3-4:30 pm (near the end 
of the work day) that the offset be shorted so that the job can be processed sooner. The 
modifications to the offset may be automatic based on a feedback loop of information or may be 
adjustable by an administrator. 

[0059] The reservation rollback policy mask is stackable allowing multiple different types of service 
or service level agreements to be simultaneously satisfied and share a collection of resources. This 
feature is illustrated in FIG. 5. A reservation 502 is shown and can generally be considered as an 
aggregation of requests from various masks 504, 506, 508 510. These are aggregated into one space 
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502 which will then allow reservations to be created on a first come first serve basis, or based on 
other factors. If these reservation masks 504, 506, 508 and 510 are stacked with individual offsets 
from the current time (not shown), the administrator can allow the masks to be partitioned among 
consumers. A useful component of this stackable approach is the capability to have an enveloping 
reservation 502 created with a total quantity of resource and rollback time offset 408 and a duration 
to the end of the SLA. Once that reservation space is established or paid for, as a service, the 
hosting center sub-partitions the space using reservation to provide service guarantees* response 
time guarantees, quantity or resources guarantees taking advantage of the stacking capability. 
[0060] A company may therefore establish the enveloping reservation 502 and request from the 
hosting center that they partition the space according to various organizations within the enveloping 
reservation 502. This eliminates the need for a large entity to have its own group of clusters of 
computer. 

[0061] Embodiments within the scope of the present invention may also include computer- 
readable media for carrying or having computer-executable instructions or data structures stored 
thereon. Such computer-readable media can be any available media that can be accessed by a 
general purpose or special purpose computer. Byway of example, and not limitation, such 
computer-readable media can comprise RAM, ROM, EEPROM, CD-ROM or other optical disk 
storage, magnetic disk storage or other magnetic storage devices, or any other medium which can be 
used to carry or store desired program code means in the form of computer-executable instructions 
or data structures. When information is transferred or provided over a network or another 
communications connection (either hardwired, wireless, or combination thereof) to a computer, the 
computer properly views the connection as a computer-readable medium. Thus, any such 
connection is properly termed a computer-readable medium. Combinations of the above should 
also be included within the scope of the computer-readable media. 

[0062] Computer-executable instructions include, for example, instructions and data which cause a 
general purpose computer, special purpose computer, or special purpose processing device to 
perform a certain function or group of functions. Computer-executable instructions also include 
program modules that are executed by computers in stand-alone or network environments. 
Generally, program modules include routines, programs, objects, components, and data structures, 
etc. that perform particular tasks or implement particular abstract data types. Computer-executable 
instructions, associated data structures, and program modules represent examples of the program 
code means for executing steps of the methods disclosed herein. The particular sequence of such 
executable instructions or associated data structures represents examples of corresponding acts for 
implementing the functions described in such steps. 
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[0063] Those of skill in the art will appreciate that other embodiments of the invention may be 
practiced in network computing environments with many types of computer system configurations, 
including personal computers, hand-held devices, multi-processor systems, microprocessor-based or 
programmable consumer electronics, network PCs, minicomputers, mainframe computers, and the 
like. Embodiments may also be practiced in distributed computing environments where tasks are 
performed by local and remote processing devices that are linked (either by hardwired links, wireless 
links, or by a combination thereof) through a communications network In a distributed computing 
environment, program modules may be located in both local and remote memory storage devices. 
[0064] Although the above description may contain specific details, they should not be construed 
as limiting the claims in any way. Other configurations of the described embodiments of the 
invention are part of the scope of this invention. Accordingly, the appended claims and their legal 
equivalents should only define the invention, rather than any specific examples given. 
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CLAIMS 

I Claim: 

1. A method of dynamically adjusting a time frame of a reservation in a compute environment, 
the method comprising: 

receiving from a requestor a request for a reservation of resources in the cluster 
environment; 

evaluating resources within the cluster environment to determine if a time frame for a 
reservation can be improved; and 

if the time frame for the reservation can be improved, then migrating the reservation from 
the first group of resources at one time to a second group of resources at a second time. 

2. The method of claim 1, wherein the cluster environment is one of an enterprise compute 
farm, a cluster and a grid. 

3. The method of claim 1, wherein the reservation is used to guarantee a response time of a 
job according to cluster environment attributes. 

4. The method of claim 1, wherein the time frame for a reservation further comprises one of 
the earliest possible time to start a reservation, an exact time to start a reservation, and a time 
duration of a reservation. 

5. The method of claim 4, wherein the improved time frame for a reservation is one of an 
expanded duration time for the reservation or a contracted duration of time for the reservation. 

6. The method of claim 1, wherein the improved time frame for a reservation comprises 
optimizing a response time for jobs submitted within the reservation. 

7. The method of claim 1, further comprising dynamically modifying the second group of 
resources according to the requested reservation. 

8. The method of claim 7, further comprising reserving the modified second group of 
resources. 

9. The method of claim 7, wherein modifying the second group of resources further comprises 
modifying attributes of the second group of resources so as to meet requirements of the request 

10. The method of claim 1, wherein evaluating resources further comprises identifying 
accessible reserved resources and free resources. 
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11. The method of claim 10, wherein the accessible reserved resources are resources which are 
contained within a reservation to which the requestor has ownership of or priority access to. 

12. The method of claim 1, wherein the first group of resources and the reservation for the 
second group of resources overlap in space and time. 

13. The method of claim 1, wherein evaluating resources further comprises identifying 
resources that currently meet requestor criteria or which could meet requestor criteria through 
modifying the resources. 

14. The method of claim 1, wherein the request comprises at least one of a requirement and a 
preference. 

15. The method of claim 14, wherein the requirement and preference relate to at least one of a 
start time, a response time, optimization, quality of service, resource quantity, cost and time 
duration. 

16. The method of claim 1, wherein the request comprises at least one request criteria of at least 
one of: computer operating system, software, network configuration information, file system 
configuration and memory requirements. 

17. The method of claim 1, further comprising, after migrating the reservation, , providing an 
access list on the reservation so as to guarantee to the requestor a response time for submitted jobs. 

18. The method of claim 17, wherein the access list comprises both credential-based data and 
performance or QOS-based data. 

19. The method of claim 1, wherein the request for resources comprises a required criteria and a 
preferred criteria. 

20. The method of claim 19, wherein the reservation of the first group of resources meets the 
required criteria. 

21. The method of claim 20, wherein evaluating resources within the cluster environment to 
determine if the time frame can be improved further comprises evaluating resources to determine if 
at least one of the preferred criteria can be met by migrating the reservation in time. 

22. The method of claim 21, wherein the determination of whether the time frame can be 
improved includes a comparison of a cost of migrating the reservation from the first group of 
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resources at the first time to the second group of resources at the second time with the improved 
time frame gained from meeting at least one of the preferred criteria. 

23. The method of claim 22, wherein the cost comprises at least one of: provisioning nodes, 
dynamically allocating data and network access and allocating software licensing associated with 
customizing resources to meet the requirement of the requestor. 

24. The method of claim 22, wherein the reservation of first group of resources is only migrated 
if the cost of migrating the reservation is less than the benefits of the improved time frame gained 
by meeting at least one of the preferred criteria. 

25. The method of claim 1, wherein evaluating resources to improve the time frame is based on 
a per-reservation policy. 

26. The method of claim 25, wherein the per-reservation policy is at least one of an 
administrator policy, a user-based policy, a policy of never taking an action, a policy of always taking 
an action and a cost-based policy. 

27. The method of claim 1, wherein the requestor may identify the request as a self-optimizing 
request. 

28. The method of claim 27, wherein a requestor is charged more for a self-optimizing request. 

29. A system for dynamically adjusting a time frame of a reservation in a compute environment, 
the system comprising: 

means for receiving from a requestor a request for a reservation of resources in the cluster 
environment; 

means for evaluating resources within the cluster environment to determine if a time frame 
for a reservation can be improved; and 

means for migrating the reservation from the first group of resources at one time to a 
second group of resources at a second time if the time frame for the reservation can be improved. 

30. A system for dynamically adjusting a time frame of a reservation in a compute environment, 
the system comprising: 

a module configured to receive from a requestor a request for a reservation of resources in 
the cluster environment; 

a module configured to evaluate resources within the cluster environment to determine if a 
time frame for a reservation can be improved; and 
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a module configured to migrate the reservation from the first group of resources at one time 
to a second group of resources at a second time if the time frrame for the reservation can be 
improved. 

31. A computer-readable medium storing instructions fo:r controlling a compute device to 
dynamically adjust a time frame of a reservation in a compute environment, the instructions 
comprising: 

receiving from a requestor a request for a reservation of resources in the cluster 
environment; 

evaluating resources within the cluster environment to determine if a time frame for a 
reservation can be improved; and 

if the time frame for the reservation can be improved, then migrating the reservation from 
the first group of resources at one time to a second group of resources at a second time. 
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establish the publication date of another citation or other special reason (as 
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"CT document referring to an oral disclosure, use, exhibition or other means 

"P" document published prior to the international filing date but later than the 
priority date claimed 



*T* later document published after the international filing date or priority date 

and not In conflict with the application but cited to understand the 
principle or theory underlying the invention 

"X" document of particular relevance; the claimed invention cannot be 

considered novel or cannot be considered to involve an inventive step 
when the document is taken alone 

"Y" document of particular relevance; the claimed invention cannot be 

considered to involve an Inventive step when the document is combined 
with one or more other such documents, such combination being obvious 
to a person skilled in tho art 
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Box No. Vni <«) DECLARATION: ENTITLEMENT TO APPLY FOR AND BE GRANTED A PATENT 

Tkedeclarationmtistconformtotkestandardized\Mrd^ see Notes to Boxes Nos. VIII VIII (Q to (v) (in general) 

and the specific Notes to Box No. VIII (U). If this Box is not used, this sheet should not be included In the request. 



Declaration as to the applicant's entitlement, as at the international filing date, to apply for and be granted a patent (Rules 4.17(ii) 
and 51 bis. 1 (a)(ii)) f in a case where the declaration under Rule 4. 1 7(iv) is not appropriate; 

in relation to this international application, 

CLUSTER RESOURCES, INC. is entitled to apply for and be granted a patent by virtue of 
the following: 

an assignment from: 

JACKSON, David Brian, 10890 S. Conestoga Drive, Spanish Fork, Utah, 84660 
United States of America 

to CLUSTER RESOURCES, INC., dated 1 0 March 2005 (03.1 0.2005) 

This declaration is made for the purposes of all designations, except for the designation 
of the U nited States of America. 



□ This declaration is continued on the following sheet, "Continuation of Box No. VTII (ii) n . 



Form PCT/RO/101 (declaration sheet (ii)) (January 2004) See Notes to the request form 
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Box No. Vni (II) DECLARATION: ENTITLEMENT TO APPLY FOR AND BE GRANTED A PATENT 

Thedeclwationmttstconfomtotkestandarfizedwordtngprotf see Notes to Boxes Nos. YIT1, VIII CO to (v) fin general) 

and the specific Notes to Box No.VIII(ii). If this Box is not used, this sheet should not be included In the request. 



Declaration as to the applicant's entitlement, as at the international filing date, to apply for and be granted a patent (Rules 4.17(H) 
and 5 1 bis, 1 (a)(ii)), in a ease where the declaration under Rule 4. 1 7(iv) is not appropriate ; 

in relation to this international application, 

CLUSTER RESOURCES, INC. is entitled to apply for and be granted a patent by virtue of 
the following: 

an assignment from: 

JACKSON, David Brian, 10890 S. Conestoga Drive, Spanish Fork, Utah, 84660 
United States of America 



to CLUSTER RESOURCES, INC., dated 10 March 2005 (03.10.2005) 

This declaration is made for the purposes of all designations, except for the designation 
of the United States of America. 



PI Th5s declaration ^ continued on the following sheet, "Continuation of Box No. VHI (ii) n . 



Form PCT/ROyi01 (declaration sheet (ii)) (January 2004) See Notes to the request form 
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MENT TO CLAIM PRIORITY 

The declaration must conform to thestandardizedwordingprovidedforin Section 213, see Notes to Boxes Nos. VUl rTffQ) to (v) (in general} 
and the specific Notes to Box No. V2IJ Qtt). tfthts Box is not used, this sheet should not be included in the request 



Declaration as to the applicant's entitlement, as at the international filing date, to claim the priority of the earlier application specified 
below, where the applicant is not the applicant who filed the earlier application or where the applicant's name has changed since the 
filing ofthe earlier application (Rnles4.17(iii) and 516fc.l(aXui)): 

in relation to this international application, 

CLUSTER RESOURCES, INC. is entitled to claim priority of earlier application 

No. 60/552,653 

by virtue of an assignment from: 

JACKSON, David Brian, 10890 S. Conestoga Drive, Spanish Fork, Utah, 84660 
United States of America 

to CLUSTER RESOURCES, INC., dated 10 March 2005 (03.10.2005) 

This declaration is made for the purposes of all designations, except for the designation 
of the United States of America. 



Q This declaration is continued on the following sheet, "Continuation of Box No. VIII (iii)" 



Form PCT/RO/I0 1 (declaration sheet (iii)) (January 2004) See Notes to the request form 
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Jtetfe*/tfmto^ see Notes to Boxes Nos. Vttl, VIKtyto (v) 

(in getiertyanV Ike $fe6ifi<?Ndti$to If this Box is not used, this sheet should not be included in the request 



Declaration of inventorship (Rules 4.17(iv) and 516&l(a)(iv)) 
for the purposes of the designation or the United States of America: 

I hereby declare that I believe 1 am the original, first and sole (if only one inventor is listed below) or joint (if more than one inventor 
is listed below) inventor of the subject matter which is claimed and for which a patent is sought 

This declaration is directed to the international application of which it forms a part (if filing declaration with application). 

This declaration is directed to international application No. PCT/ (if furnishing declaration pursuant 

to Rule 26fer). 

I hereby declare that my residence, mailing address, and citizenship are as stated next to my name. 

I hereby state that I have reviewed and understand the contents of the above-identified international application, including the claims 
of said application. I have identified in the request of said application, in compliance with PCT Rule 4. 1 0, any claim to foreign priority, 
and I have identified below, under the heading "Prior Applications " by application number, country or Member of the World Trade 
Organization, day, month and year of filing, any application for a patent or inventor's certificate filed in a country other than the United 
States of America, including any PCT international application designating at least one country other than the United States of America, 
having a filing date before that of the application on which foreign priority is claimed. 

Prior Applications: 



I hereby acknowledge the duty to disclose information that is known by me to be material to patentability as defined by 
37 C.F.R. § 1.56, including for continuation-in-part applications, material information which became available between the filing date 
of the prior application and the PCT international filing date of the continuation-in-part application. 

I hereby declare that all statements made herein of my own knowledge are true and that all statements made on information and belief 
are believed to be true; and further that these statements were made with the knowledge that willful false statements and the like so 
made are punishable by fine or imprisonment, or both, under Section 1001 of Title 1 8 of the United States Code and that such willful 
false statements may jeopardize the validity of the application or any patent issued thereon. 

Name: P?Yl d . Brian Jackson 

Residence: $PW^ F«fc .Utah 

(city and either US state, if applicable, or country) 

Mailing Address: . J0?9D.$.Cpn<^tpg9 .Drive 

Spanish Fork, UT 84660 



Citizenshipr USA 



Inventor's Signature: ibJ.i&rjJ. Date: . . . 2?./. / ./ 

(if not contained in the request, & if declaration is corrected or (of signature which is not contained in the request, or of the 

added under Rule 26ter after the filing of the international declaration that is corrected or added under Rule 26/er after the 

application. The signature must be that of the inventor, not that of filing of the international application) 
the agent) 



Name; 

Residence: « , 

(city and either US state, if applicable, or country) 

Mailing Address: 



Citizenship: 

Inventor's Signature: 

(if not contained in the request, or if declaration is corrected or 
added under Rule 26/er after the filing of the international 
application. The signature must be that of the inventor, not that of 
the agent) 



Date: 

(of signature which is not contained in the request, or of the 
declaration that is corrected or added under Rule 26/er after the 
filing of the international application) 



□ This declaration is continued on the following sheet, "Continuation of Box No. VIII (iv)". 



Form PCT/RO/10I (declaration sheet (iv)) (January 2004) 



See Notes to the request form 
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nedeclaroJtonmustconformtothestmdardizedwo^ see Notes to Boxes Nos. VUl VIII (Q to (y) (In general) 

and the specific Notes to Box No. VIII pit). If this Box Is not used, this sheet should not be included in the request 



Declaration as to the applicant's entitlement, as at the international filing date, to claim the priority of the earlier application specified 
below, where the applicant is not the applicant who filed the earlier application or where the applicant's name has changed since the 
filing of the earlier application (Rules 4.17(iii) and 51 £«.l(aXtii»: 

in relation to this international application, 

CLUSTER RESOURCES, INC. is entitled to claim priority of earlier application 

No. 60/552,653 

by virtue of an assignment from: 

JACKSON, David Brian, 10890 S. Conestoga Drive, Spanish Fork, Utah, 84660 
United States of America 

to CLUSTER RESOURCES, INC., dated 10 March 2005 (03.10.2005) 

This declaration is made for the purposes of all designations, except for the designation 
of the United States of America. 



Q This declaration is continued on the following sheet, "Continuation of Box No. VIII (Hi)". 



FormPCT/RO/101 (declaration sheet (iii)) (January 2004) 



See Notes to the request form 
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Declaration of inventorship (Rules 4.17(iv)and 51ofr.l(a)(iv)) 
for the purposes of the designation of the United States of America: 



I hereby declare that I believe I am the original, first and sole (if only one inventor is listed below) or joint (if more man one inventor 
is listed below) inventor of the subject matter which is claimed and for which a patent is sought 

This declaration is directed to the international application of which it forms a part (if filing declaration with application). 

This declaration is directed to international application No. PCT/ (if famishing declaration pursuant 

to Rule 26/er). 

I hereby declare that my residence, mailing address, and citizenship are as stated next to my name. 

I hereby state that I have reviewed and understand the contents of the above-identified international application, including the claims 
of said application. I have identified in the request of said application, in compliance with PCT Rule 4. 1 0, any claim to foreign priority, 
and I have identified below, under the heading "Prior Applications/* by application number, country or Member of the "World Trade 
Organization, day, month and year of filing, any application for a patent or inventor's certificate filed m a country other than the United 
States of America, including any PCT international application designating at least one country other than the United States of America, 
having a filing date before that of the application on which foreign priority is claimed. 

Prior Applications: 



I hereby acknowledge the duty to disclose information that is known by me to be material to patentability as defined by 
37 C.F.R. § 1 .56, including for continuation-in-part applications, material information which became available between the filing date 
of the prior application and the PCT international filing date of the continuation-in-part application. 

I hereby declare that all statements made herein of my own knowledge are true and that all statements made on information and belief 
are believed to be true; and further that these statements were made with the knowledge that willful false statements and the like so 
made are punishable by fine or imprisonment, or both, under Section 1001 ofTitle 1 8 of the United States Code and that such willful 
raise statements may jeopardize the validity of the application or any patent issued thereon. 

Name: PWS WW Jackson ........ j ................... . 

Residence; S???!* 

(city and either US state, if applicable, or country) 

Mailing Address: . 1039D.SXpnets:tQg9 .Drive 

Spanish Fork, UT 84660 



Citizenship: USA 



I inventor's Signature: IbL^ / Date: ... 3/ / 5?. 1. ^ 

(if not contained in the request, vJ if declaration is corrected or (of signature which is not contained in the request, or of the 

added under Rule 26ter after the filing of the international declaration that is corrected or added under Rule 26/er after the 

application. The signature must be that of the inventor, not that of filing of the international application) 
the agent) 



Name: 

Residence: 

(city and either US state, if applicable, or country) 

Mailing Address: 



Citizenship: 

Inventor's Signature: 

(if not contained in the request, or if declaration is corrected or 
added under Rule 26ter after the filing of the international 
application. The signature must be that of the inventor, not that of 
the agent) 



Date: 

(of signature which is not contained in the request, or of the 
declaration that is corrected or added under Rule 26ter after the 
filing of the international application) 



□ This declaration is continued on the following sheet, "Continuation of Box No. VIII (iv)". 
Form PCT/RO/1 01 (declaration sheet (iv)) (January 2004) See Notes to the request form 



